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Abstract 

We propose a general framework for investigating a large class of stabi- 
lization problems in Markovian quantum systems. Building on the notions 
of invariant and attractive quantum subsystem, we characterize attractive 
subspaces by exploring the structure of the invariant sets for the dynam- 
ics. Our general analysis results are exploited to assess the ability of 
open-loop Hamiltonian and output-feedback control strategies to synthe- 
size Markovian generators which stabilize a target subsystem, subspace, or 
pure-state. In particular, we provide an algebraic characterization of the 
manifold of stabilizable pure states in arbitrary finite-dimensional Marko- 
vian systems, that leads to a constructive strategy for designing the rel- 
evant controllers. Implications for stabilization of entangled pure states 
are addressed by example. 

Keywords: Quantum control; Quantum dynamical semigroups; Quantum sub- 
systems. 



1 Introduction 

Stabilization problems have a growing significance for a variety of quantum con- 
trol applications, ranging from state preparation of optical, atomic, and nano- 
mechanical systems to the generation of noise-protected realizations of quantum 
information in realistic devices [2 [5] . Dynamical systems undergoing Marko- 
vian evolution [3l |4] are relevant from the standpoint of typifying irreversible 
quantum dynamics and present distinctive control challenges l5l. In particular, 
open-loop quantum-engineering and (approximate) stabilization methods based 
on dynamical decoupling cease to be viable in the Markovian regime [51 [7] . It 
is our goal in this work to show how a wide class of Markovian stabilization 
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problems can nevertheless be effectively treated within a general framework, 
provided by invariant and attractive quantum subsystems. 

After providing the relevant technical background, we proceed establishing a 
first analysis result that fully characterizes the attractive subspaces for a given 
generator. This is done by analyzing the structure induced by the generator 
in the system's Hilbert space, and by invoking Krasowskii-LaSalle's invariance 
principle. We next explore the application of the result to stabilization prob- 
lems for Markovian Hamiltonian and output-feedback control. Our approach 
leads to a complete characterization of the stabilizable pure states, subspaces, 
and subsystems as well as to constructive design strategies for the control pa- 
rameters. Some partial results in this sense have been presented in [S], and 
in the conference paper [9]. We also refer to the journal article [8] for a more 
detailed discussion of the connection between invariant, attractive and noiseless 
subsystems, along with a thorough analysis of model robustness issues which 
shall not be our focus here. 

2 Preliminaries and background 

2.1 Quantum Markov processes 

Consider a separable Hilbert space TL over the complex field C. Let *B(7i) rep- 
resent the set of linear bounded operators on Ti, with f){T-l) denoting the real 
subspace of Hermitian operators, and I, O being the identity and the zero op- 
erator, respectively. Throughout our analysis, we consider a finite- dimensional 
quantum system Q: following the standard quantum statistical mechanics for- 
malism [Till, we associate to Q a complex, finite-dimensional Ti.. Our (possibly 
uncertain) knowledge of the state of Q is condensed in a density operator p on 7i, 
with p > and trace(p) ~ 1. Density operators form a convex set D{'H) C SjCH), 
with one-dimensional projectors corresponding to extreme points {pure states., 
P\ip) = Observable quantities are represented by Hermitian operators 

in ^(7i), and expectation values are computed by using the trace functional: 
Ep(X) — trace(pX). If Q is the composite system obtained from two distin- 
guishable quantum systems Qi, Q2, the corresponding mathematical descrip- 
tion is carried out in the tensor product space, 7ii2 — Ti-i ®'H2, observables and 
density operators being associated with Hermitian and positive-semidefinite, 
normalized operators on 7ii2, respectively. The partial trace over 7^2 is the 
unique hnear operator trace2(-) : 5B(7Yi2) ^ S('^i), ensuring that for every 
Xi e *B('Hi),X2 e *B(7^2), trace2(Xi ® X2) = Xitrace(X2). Partial trace is 
used to compute marginal states and partial expectations on multipartite sys- 
tems. 

In the presence of either intended or unwanted couplings (such as with a 
measurement apparatus, or with a surrounding quantum environment), the 
evolution of a subsystem of interest is no longer unitary and reversible, and 
the general formalism of open quantum systems is required [111 [31 13] ■ A wide 
class of open quantum systems obeys Markovian dynamics [31 [T^l [131 H] . Let 1 
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denote the physical quantum system of interest, with associated Hilbert space 
Til, dim(H/) = d. Assume that we have no access or control over the state of 
the system's environment, and that the dynamics in D{Ti,i) is continuous in time 
and described at each instant t > by a Trace-Preserving Completely Positive 
(TPCP) linear map %{■) [13]. If a forward composition law is also assumed, we 
obtain a quantum Markov process, or Quantum Dynamical Semigroup (QDS): 

Definition 1 (QDS) ^ quantum dynamical semigroup is a one-porameter/am- 
ily of TPCP maps {%{■), t > 0} that satisfies: 

. To = I, 

• TtoTs^ Tt+s, Vi, s > 0, 

• tvace{Tt{p)X) is a continuous function oft, \/ p G D{l-Li), VX G B{Tii). 

Due to the trace- and positivity-preserving assumptions, a QDS is a semigroup 
of contractions. As proven in [T2lll5j . the Hille-Yoshida generator for the semi- 
group exists and can be cast in the following canonical form: 

p 

p{t) = Cipit))=-UH,p{t)]+J2lkViLk,pit)) (1) 

fc=i 

p , 
- -'-[H,pit)]+J2lk(LkPit)Ll - -{lILu, 
fc=i 

with {7fc} denoting the spectrum of A. The effective Hamiltonian H and the 
noise operators Lk (also known as "Lindblad operators" ) completely specify 
the dynamics, including the effect of the Markovian environment. In general, 
H is equal to the Hamiltonian for the isolated, free evolution of the system, 
Hq, plus a correction, Hl, induced by the coupling to the environment (aka 
"Lamb shift"). The non-Hamiltonian terms 'D{Lk, p{t)) in ([1]) account for the 
non-unitary character of the dynamics, specified by noise operators {Lk}. 

In principle, the exact form of the generator of a QDS may be rigorously 
derived from a Hamiltonian model for the joint system-environment dynamics 
under appropriate limiting conditions (the so-called "singular coupling limit" 
or the "weak coupling limit," respectively [HI!])- In most physical situations, 
however, an analytical derivation is unfeasible, since the full microscopic Hamil- 
tonian describing the system-environment interaction is unavailable. A Marko- 
vian generator of the form ([1]) is then postulated on a phenomenological basis. 
In practice, it is often the case that knowledge of the noise effect may be as- 
sumed, allowing to specify the Markovian generator by directly assigning a set 
of noise operators Lk (not necessarily orthogonal or complete) in ([T]), and the 
corresponding noise strengths 7^. Each of the noise operators Lk may be asso- 
ciated to a distinct noise channel V^Lk, p{t)), by which information irreversibly 
leaks from the system to the environment. 
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2.2 Quantum subsystems: Invariance and attractivity 



Quantum subsystems are the basic building block for describing composite sys- 
tems in quantum mechanics |10| , and provide a general framework for scalable 
quantum information engineering in physical systems. In fact, the so-called sub- 
system principle [21[TJ[Tn] states that any "faithful" representation of information 
in a quantum system requires to specify a subsystem desired information. Many 
of the control tasks considered in this paper are motivated by the need for strate- 
gies to create and maintain quantum information in open quantum systems. A 
definition of quantum subsystem suitable to our scopes is the following: 

Definition 2 (Quantum subsystem) A quantum subsystem S of a system 
X defined on TLj is a quantum system whose state space is a tensor factor Tig 
of a subspace Hsf of Hi, 



for some co-factor TLp and remainder space TLr. The set of linear operators on 
S, B{Hs), has the same statistical properties and is isomorphic to the (associa- 
tive) subalgebra of B{TLi) of operators of the form Xj = Xs ®If ® 0_r- 



Let n = dim(Ws), / = dim(Wj.), r = dim(Hi?), and let {|0f)}Li, 



be orthonormal bases for Hs, Hp, Hr, respectively. The decompo- 
sition ^ is then naturally associated with the following basis for Hi: 



where, in general, Xsf 7^ Xs ® Xp- We denote by Hsf the projector onto 
Hsf, that is, Usf = ( Isf | ). 

In this paper, we study Markov dynamics of a quantum system X with a given 
decomposition of the associated Hilbert space of the form ([2]) , with respect to 
the quantum subsystem S associated to Hs ■ By describing the dynamics in the 
Schrodinger picture, i.e. , with evolving states and time-invariant observables, 
the first step is to specify whether the system X has been properly initialized in 
a state which faithfully represents a state of the subsystem S, and what is the 
structure of such states. 

Definition 3 (State initialization) The system X with state p E D{Hi) is 
initialized in Hs with state ps G Ti(Hs) if the blocks of p satisfy: 

(i) PSF ^ Ps® Pf for some pp e D{Hp); 

(ii) pp = Q,pR = 0. 

We denote by 3s{Hi) the set of states that satisfy (i)-(ii) for some ps- 



Hi = Hsf ®Hr = {Hs Hp) ® Hr 



(2) 



{\^,n)} = {\<p^)®\<i>^)y;;Li 



This induces a block structure for matrices acting on Hi: 




(3) 
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Condition (ii) guarantees that ps = trSiCeFiJ^SF P^sf) ^ valid (normal- 
ized) state of iS, while condition (i) ensures that measurements or dynamics 
affecting the factor Tip have no effect on the state in Tig. 

We now proceed to characterize in which sense, and under which conditions, 
a quantum subsystem may be defined as invariant. Recall that a set W is said 
to be invariant for a dynamical system if the trajectories that start in W remain 
m W for all t > 00 In view of Definition [3l the natural definition considering 
dynamics in the state space may be phrased as follows: 

Definition 4 (Invariance) Let I evolve under a family of TPCP maps {Tt, t > 
0}. S is an invariant subsystem if3s{TLi) is an invariant subset ofD{TLi). 

In explicit form, as given in [5], this means that ^ ps ^ DiTis), Pf G T){Hp), 
the state of X obeys 



Ps ® Pf 












T,^{ps)®r/ipp 











t > 0, (4) 



where, for every t > 0, and Tf{-) are TPCP maps on Tis and Tipj 

respectively, not depending on the initial state. For Markovian evolution of X, 
{Xf} and {Xf^} are required to be QDSs on their respective domain. 

We next recall a characterization of dynamical models able to ensure in- 
variance for a fixed subsystem, based on appropriately constraining the block- 
structure of the matrix representation of the operators specifying the Markovian 
generator. We refer to for the proofs. 

Lemma 1 (Markovian invariance) Assume that Hi = [Tis ® Tip) © Tip, 
and let H, {Lk} be the Hamiltonian and the error generators of a Markovian 
QDS as in Then TLs supports an invariant subsystem iffy k: 

Lk = 
iHp - 



Ls.k ® Lp k 


Lp^k 





Lp^k , 



^E(4,fe®4.fe = o- (5) 

Hsf = lls®^F + ^S® Hp, 

where for each k either Ls^k — or Lp^k ~ ^F (or both). 

One may require S to have dynamics independent from evolution affecting 
Tip and Tip also in the case where X is not initialized in the sense of Definition 



^For clarity, let us also recall other standard dynamical systems notions relevant in our 
context. Given p = C{p) and a suitable norm for the state manifold, we call invariant, 
stationary, or equilibrium state any p such that p = 0. An equilibrium state p is said to be 
stable if for every e > there exists 5 such that if ||po — p|| < 5, then any trajectory starting 
from po does not leave the ball of radius t centered in p. A state p is said to be (globally) 
attractive if the trajectories from any initial condition converge to it. 
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[31 If neither conditions (i)-(ii) are satisfied, one may still define an imnormalized 
reduced state for the subsystem: 

PS = traceF(n5Fpn^f^), trace(ps) < 1- 

This allows for entangled mixed states to be supported on TisF, as well as for 
blocks pp, p_r to differ from zero. Similar to the case of so-called "initialization- 
free" subsystems considered in |T7l [8] , an additional constraint on the Lindblad 
operators is required to ensure independent reduced dynamics in this case. That 
is, with respect to the matrix block-decomposition above, it must be Lp^k = 
for every k. Such a constraint decouples the evolution of the SF-block of the 
state from the rest, rendering both Jsi'Hi) and 3p(7i/) separately invariant. 

This imposes tighter conditions on the noise operators, which may be hard to 
ensure in reality and, from a control perspective, leave less room for Hamiltonian 
compensation as examined in Section [4. II In order to address situations where 
such extra constraints cannot be met, as well as a question which is interesting 
on its own, we explore conditions for a subsystem to be attractive: 

Definition 5 (Attractive subsystem) Assume that Hi — {Hs '8)'Hf) QHr. 
Then Tis supports an attractive subsystem with respect to a family {Tt}t>o of 
TPCP maps if^p G Tl{Ti.j) the following condition is asymptotically obeyed: 



lim [Tt{p) 



ps{t) (S) pF{t) 



where 







0, (6) 



ps{t) tra.ceF[nsFTt{p)Illp], 

PF{t) = traces [nsF^(p)n^F]- 

This imphes that every trajectory in D{Ti.i) converges to IsO^i)- Thus, an 
attractive subsystem may be thought of as a subsystem that "self-initializes" 
in the long-time limit, by reabsorbing initialization errors. Although such a 
desirable behavior only emerges asymptotically, for QDSs one can see that con- 
vergence is exponential, as long as the relevant eigenvalues of C have strictly 
negative real part. 

We conclude this section by recalling two partial results on attractive sub- 
systems which we established in 8 . The first is a negative result, which shows, 
in particular, how the possibility of "initialization- free" and attractive behavior 
are mutually exclusive. 

Proposition 1 Assume that Hi — {Hs (^Hf) ^Ti-R, Hr ^ 0, and let H, {Lk} 
be the Hamiltonian and the error generators as in ([T]), respectively. Let Hs 
support an invariant subsystem. If Lp^k = Lq — for every k, then Hs is not 
attractive. 

Note that he conditions of the above Proposition are obeyed, in particular, 
if Lfc = ip, Vfc. As a consequence, attractivity is never possible for the class of 
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unital (I-preserving) Markovian QDSs with purely self-adjoint Lfc's. Still, even 
if the condition Lp^k = L^q fe = condition holds, attractive subsystems may 
exist in the pure-factor case, where Hr = 0. Sufficient conditions are provided 
by the following: 

Proposition 2 Assume thatHi = 'Hs®'Hf (Hp, = 0), and letHs be invariant 
under a QDS with generator of the form 

C = Cs <»If + h <^ ^F- 

If Cf{-) has a unique attractive state pp, then TLs is attractive. 

Interesting linear-algebraic conditions for determining whether a generator 
Cf{-) has a unique attractive state (though not necessarily pure) are presented 
in [IHIITS]. 

3 Characterizing attractive Markovian dynam- 
ics 

We begin by presenting new necessary and sufficient conditions for attractivity 
of a subspace, which will provide the basis for the synthesis results in the next 
sections. Notice that if Tisp supports an attractive subsystem, the entire set of 
states with support on Tisp, '3sf{Hi)i is attractive. Once this is verified, the 
dynamics confined to the invariant subspace (that supports a pure subsystem) 
may be studied with the aid of the results recalled in the previous section. 
The following Lemma will be used in the proof of the main result, but is also 
interesting on its own. We denote with supp(X) the support of X € 55(7i), i.e., 
the orthogonal complement of its kernel. 

Lemma 2 Let W he an invariant subset ofDiTii) for the QDS dynamics gen- 
erated by p ~ C{p), and define: 



Then Uvv('^/) "is invariant. 

Proof. Let W be the convex hull of W. Thus, every element p of W may be 
expressed as p = J2kPkPk, where pk > 0, J2kPk = Ij and pi, . . . , pfe € W. By 
using linearity of the dynamics. 



with p[, . . . , p'f. S W. Hence W is invariant. Furthermore, from the definition 



Hw = supp(yV) = [J supp(p). 

pew 



fe fe 



of W, there exist a p € W such that supp(p) — supp(W) = Hw- Consider 
Til — Hw ffi H^, and the corresponding matrix partitioning: 
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With respect to this partition, the block pyy of p is full-rank, while pp^q^r are 
zero-blocks. The trajectory {7^(p), i > 0} is contained in VV only if: 















dtp- 

so that, upon computing explicitly the generator blocks, we must impose: 
j [iHp - \ J2k fe^i'-fc ) = 0' 



2 ^W,k 

2 l^kX^Q 

Since pvv is full-rank and positive, it must be: 



\T.k{LQ.kLQ,k, Pw} = 0. 



Lq^k = 0, Vfc. 

Comparing with the conditions given in Corollary [1] we infer that Uyvl^/) is 
invariant, hence we conclude. □ 

We are now in a position to prove our main result: 

Theorem 1 (Subspace attractivity) Let Hi = Tis Tin, and assume that 
Tis is an invariant subspace for the QDS dynamics generated by ([T]). Define: 

p 

Ur. = fl ker(ip,fc), (7) 

k=l 

with the matrix blocks Lp^k representing linear operators from Tip to TLs- Then 
Jis is an attractive subspace ijfHp/ does not support any invariant subsystem. 

Proof. Clearly, if Ti.pi supports an invariant set Wp, then Tis cannot be at- 
tractive, since for every p e Wp, the dynamics is confined to Wp. To prove 
the other implication, we shall prove that if Tip' does not support an invari- 
ant set, then Tis is attractive. Consider the non-negative, linear functional 
V{p) = trace(nfl;p). It is zero iff pp ~ 0, i.e., for perfectly initialized states. By 
LaSalle's invariance principle (see e.g. [20]). every trajectory will converge to 
the largest invariant subset W contained in the set: 

z = {peT){ni)\v{p)^o}. 

Explicit calculation of the blocks of the generator (see also 8, ) yields: 
V{p) = tTace{IlpC{p)) = -trace(^^ L^pj^Lp^kPP^ ■ 

k 

By the cyclic property of the trace, the last term is equivalent to the trace 
of Lp^kppL^p ^, which is a sum of positive operators, and thus can be zero 
iff each term is zero. Being the Lp^kS fixed, this can hold iff pp has support 
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contained in Hr' , defined as above. Thus, the support of Z is Hs ffi 'Hw . Call 
Tivv the support of the maximal invariant set W in Z: By Lemma [2l 3w(^/) 
is invariant. But W is defined as the maximal invariant set in .E, so it must be 
W = rJw('^/)- Recalling that by hypothesis Us(H/) is itself an invariant subset 
contained in Z, it must be Hvv = T^S © T^R"^ with H_r," C T-Lr'. We next prove 
that T-Lri supports an invariant set iff Hyv 7^ '^s, i-e. 'Wi?' ^ (H- Consider a 
p € W such that p has non-trivial support on Ti-g- If no such state exists, W 
has support only on Tig, so clearly Tij^/ = 0. If such a state exists, let 

_ n_R//5n_R/ 

trace(nH//5) ' 

where 11^/ is the orthogonal projector on TLn/. Since p' has support only on 
Ti-R' C H-w, its trajectory {p'{t) = Tt{p'),t > 0} is confined to W. On the 
other hand, W C Z, hence it must be V{p{t)) = for all t > 0. By observing 
that V{p') — 1 and that V{p), V{p) are continuous, we can conclude that the 
trajectory {p'{t)} must have support only on some Hr" C Hr', endowing TIri 
with an invariant set, and by the Lemma above, the invariant subsystem asso- 
ciated to 3r"{T-Li). We conclude by observing that if T-Lr' does not support an 
invariant set, then Tiyy = Tig, hence T-Ls is attractive. □ 

In spite of its non-constructive nature, the power of this characterization 
will be apparent in the proofs of the results concerning active stabilization of 
states and subspaces by Hamiltonian control in the next section. We observe 
here that Lemma [5] lends itself to the following useful specialization: 

Proposition 3 If p is an invariant state for the QDS dynamics generated by 
p = C{p), and Hb = supp{p), then Isi'Hi) is invariant. Conversely, if TH, 
supports an invariant subset, it contains at least an invariant state. 

Proof. The first implication follows from Lemma [2] above. If supports an 
invariant subset, then by the same Lemma it supports an invariant subsystem, 
and the density operators with support on Ti, form a convex, compact set that 
evolves accordingly to a (reduced) QDS. Hence, it must admit at least an in- 
variant state [3]. □ 

This result provides us with an explicit criterion for verifying whether T-Lr/ 
contains an invariant subset: It will suffice to check if T-Lr/ supports an invariant 
state. Invariant (or "fixed") states may be found by analyzing the structure of 
ker(£(-)). An efficient algorithm for generic TPCP maps has been recently 
presented in [16] . 

4 Engineering attractive Markovian dynamics 

In this section, we illustrate the relevance of the theoretical framework devel- 
oped thus far to a wide class of Markovian stabilization problem associated with 

■^To the scope of this proof, the "if" imphcation would suffice, but since the converse arises 
naturally, we prove both. 
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the task of making a desired (fixed) quantum subsystem invariant or attractive. 
Interestingly, these problems may be regarded as instances of Markovian reser- 
voir engineering, which has long been investigated on a phenomenological basis 
by the physics community in the context of both decoherence mitigation and 
the quantum-classical transition, see e.g. [^[^1^ . 

In the special yet relevant case of sinthesizing attractive dynamics with re- 
spect to an intended pure state, our results fully characterize the manifold of 
pure states that may be "prepared" given a reference dissipative dynamics us- 
ing either open-loop Hamiltonian or feedback control resources. As discussed 
in [5], provided a sufficient level of accuracy in tuning the relevant control pa- 
rameters may be ensured, the "direct" Markovian feedback considered here has 
the important advantage of substantially relaxing implementation constraints 
in comparison with "Bayesian" feedback techniques requiring real-time state 
estimation update [211 ES] . 

4.1 Open- loop Hamiltonian control 

We begin by exploring what can be achieved by considering only open-loop 
Hamiltonian control, specifically, the application of time-independent Hamilto- 
nians to the dynamical generator. This allows us to consider generators in- 
volving, in general, multiple Lk, and yields interesting characterizations of the 
possibilities offered by this class of controls for stabilization problems, comple- 
menting previous work from a controllability perspective [261 127] . The results 
established below will also be of key importance in the proofs of the theorems 
on closed-loop stabilization. Lastly, a separate presentation will serve to clarify 
the different scopes and limitations of the two class of control strategies. As a 
direct consequence of the Markovian invariance theorem, we have the following: 

Corollary 1 (Open-loop invariant subspaces) Let Hi = Hs ® "Hr. Then 
JsO^i) can be made invariant by open-loop Hamiltonian control iff Lg^k = 
for every k. 

Proof. By specializing Corollary [1] Tis supports an invariant subsystem iff: 

LQ,k^O, Vfc (8) 
'Hp-lj2^s,kLp,k^0. (9) 

k 

The only condition that is affected by a change of Hamiltonian is ([9|), which 
however can always be satisfied by an appropriate choice of control Hamiltonian. 
This leaves us with condition ([5]) alone. □ 

The above result makes it possible to enforce invariant subspaces for the con- 
trolled dynamics by solely using Hamiltonian resources, without directly mod- 
ifying the non-unitary part. The ability of open-loop Hamiltonian control to 
induce stronger attractivity properties is characterized in the following: 
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Theorem 2 (Open-loop attractive subspaces) Let Hi = Hs ffi Hr and 

assume that Hs supports an invariant subsystem. Then '3s{Hi) can he made 
attractive by open-loop Hamiltonian control iff 3r{Hi) is not invariant. 

Proof. If H u supports an invariant subsystem, then by Corollary [T] it must be 
Lp.k = for every k. Since Hs invariant, this implies Hp ~ 0. Any Hamil- 
tonian control perturbation that preserves invariance on Hs must satisfy this 
condition, hence preserve invariance on Hp too, thus Hs cannot be rendered 
attractive. If the whole Hp, does not support an invariant subsystem, we can 
devise an iterative procedure that builds up a control Hamiltonian He such that 
Hs becomes attractive. Theorem[T]states that if there is no invariant subsystem 
supported in Hp/ (defined in ([7])), then Hs is attractive. If there is an invariant 
subsystem with support Ht C Hp/, let us consider the following Hilbert space 
decomposition: 

Hi =Hs®Ht®Hz. 

After imposing the invariance conditions on Hs and Ht, the associated block- 
decomposition of the Lindblad operators and Hamiltonian turns out to be of 
the form: 



Ls,k 





Lp'^k 





Lr.k 


Lp".k 








Lz.k , 



H = 


( Hs 





Hp, 







Hp,, 




hU 


Hz 



subject to the conditions: 



0, 



^Hp' -^Y^^SM^P', 

k 

iHp„ - = 



One sees that the most general Hamiltonian perturbation that preserves the 
invariance of Hs has the form: 



He = 



Hi 











H2 


Hm 





Hi 


Hs , 
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Consider a control Hamiltonian He such that the block Hm has full column- 
rank, while Hi, H^ are arbitrary and H2 is still to be determined. If dim(7iT) < 
^dim{Hp), then ipxH^^i ^ for every px, hence Ht cannot support any in- 
variant subsystem, since conditions in Corollary [T] cannot be satisfied for any 
subspace of Ht- Conversely, if dim{HT) > |dim(Hfl), choosing an Hm as 
above, by dimension comparison Hm must have a non-trivial left kernel /C, 
JCHm = 0, and thus there exists a Ht' C K, that supports an invariant 3t'{Hi), 
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whose dimension is strictly lesser than dimension of dim(7ir). We can iterate 
the reasoning with a new, refined decomposition Tii = Tig © T^T' ® "Hz' , with 
Tiz' = Ti-z ® (Ji-T Q 'Ht')- With this decomposition, the generator matrices 
exhibits the same block structure as above, with dim(7iT') < dim(7iT)- Thus, 
we can exploit the freedom of choice on the block H2 to further reduce the 
dimension of the invariant set. At each iteration, the procedure either stops 
rendering Tis attractive, if dim(7^T) < ^(\m\{T-LR)^ or decrease the dimension 
of the invariant set by at least 1. The procedure thus ends in at most dim(7ifl/) 
steps. □ 

Remarkably, the proof of the above theorem, combined with a strategy to 
find invariant subspaces, provides a constructive procedure to build a constant 
Hamiltonian that makes the desired invariant subspace attractive whenever the 
Theorem's hypothesis are satisfied. 



4.2 Markovian feedback control 

The potential of Hamiltonian compensation for controlling Markovian evolutions 
is clearly limited by the impossibility to directly modify the noise action. To 
our scopes, open-loop control is then mostly devoted to connect subspaces in H. 
that are already invariant, and to adjust the generator parameters so that the 
interplay between Hamiltonian and dissipative contributions (as in Eq. ([5])) can 
stabilize the desired subspace or subsystem. 

A way to overcome these limitations is offered by closed-loop control strate- 
gies. Measurement-based feedback control requires the ability to both effectively 
monitor the environment, and condition the target evolution upon the measure- 
ment record. Feedback strategies have been considered since the beginning of 
the quantum control field [55], and successfully employed in a wide variety of 
settings (see e.g. [Ml [301 HI 1311 132] ) ■ 

We focus on a measurement scheme which mimics optical homo-dyne de- 
tection for field-quadrature measurements, whereby the target system {e.g. an 
atomic cloud trapped in an optical cavity) is indirectly monitored via measure- 
ments of the outgoing laser field quadrature [291 ES] ■ The conditional dynamics 
of the state is stochastic, driven by the fluctuation one observes in the measure- 
ment. Considering a suitable infinitesimal feedback operator determined by a 
feedback Hamiltonian F, and taking the expectation with respect to the noise 
trajectories, this leads to the Wiseman-Milburn Markovian Feedback Master 
equation (FME) [221 [30]: 



pt = -ih 



H + i(FM + M^F), pt\ + V{M - iF, pt). (10) 



The feedback state-stabilization problem for Markovian dynamics has been 
extensively studied for a single two- level system [qubit] [34l [35]. The stan- 
dard approach is to to design a Markovian feedback loop by assigning both 
the measurement and feedback operators M, F, and to treat the measurement 
strength and the feedback gain as the relevant control parameters accordingly. 
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Throughout the following section, we will assume to have more freedom, by con- 
sidering, for a fixed measurement operator M, both F and H as tunable control 
Hamiltonians 

Definition 6 (CHC) A controlled FME of the form (flOl) supports complete 
Hamiltonian control (CHC) if (i) arbitrary feedback Hamiltonians F e Sj{T-li) 
may be enacted; (ii) arbitrary constant control perturbations He € f){TLi) may 
be added to the free Hamiltonian H . 

This leads to both new insights and constructive control protocols for sys- 
tems where the noise operator is a generalized angular momentum-type observ- 
able, for generic finite-dimensional systems. Physically, the CHC assumption 
must be carefully scrutinized on a case by case basis, since constraints on the 
form of the Hamiltonian with respect to the Lindblad operator may emerge, 
notably in the abovementioned weak-coupling limit derivations of Markovian 
models 

We now address the general subspace-stabilization problem for controlled 
Markovian dynamics described by FMEs. A characterization of the subspaces 
supporting stabilizable subsystems is provided by the following: 

Theorem 3 (Feedback attractive subspaces) Let Hi — 'Hs®'Hr, withUs 
being the orthogonal projection on TLs- Assume CHC capabilities. Then, for any 
measurement operator M , there exist a feedback Hamiltonian F and a Hamilto- 
nian compensation He that make the subsystem supported by Tis attractive for 



Proof Write M = + iM"^, with both and being Hermitian, thus 
L = + i{M^ - F). Condition ^ holds iff M" is not block-diagonal when 
partitioned according to the chosen decomposition. If is block-diagonal, 
then, by Corollary [1] enforcing invariance of the subsystem supported by Tig 
requires that Lq — 0. But then it must also be Lp = 0, so that T-Lr supports an 
invariant subsystem. Since the choice oiLg and Lr does not affect invariance, by 
Theorem[5]it follows that TLs cannot be made attractive by Hamiltonian control. 
On the other hand, if is not block-diagonal, we can always find F in such 
a way that L is upper diagonal, Lp ^ 0, by choosing Fp = iM0 + Mp. With 
L as the new noise operator, we now have to devise a control Hamiltonian He 
with a block Hc.p that makes Hs invariant (this is always possible by Corollary 
[U since Lq=0), and a block i?c,_R constructed following the procedure in the 
proof of Theorem [2l □ 

The following specialization to pure states, i.e. one-dimensional subspaces, 
is immediate: 

Corollary 2 Assume CHC. For any measurement operator M , there exist a 
feedback Hamiltonian F and a Hamiltonian compensation He able to stabilize 
an arbitrary desired pure state pd for the FME (jlOp iff 



the FME (Uni) iff 



[Hs, (M + M^)] ^ 0. 



(11) 



[pd, {M + A/t)] ^ 0. 



(12) 
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The proof of Theorem [3] provides a constructive algorithm for designing 
the feedback and correction Hamiltonians needed for the stabihzation task. In 
particular, our analysis recovers the qubit stabilization results of [33] recalled 
before. For example, the states that are not stabilizable within the control 
assumptions of [33] are the ones commuting with the Hermitian part of Af = cr_|_, 
that is, = ax- In the xz-plane of the Bloch's representation, the latter 

correspond precisely to the equatorial points. 

As a corollary of Theorem[3]and Proposition[21 we present sufficient and nec- 
essary conditions for engineering a generic attractive quantum subsystem (with 
a non-trivial co-factor). We start with a Lemma, which is a straightforward 
specialization of Proposition 5 in [5]: 

Lemma 3 Assume that TLi — TLs 'Si "Hp, (Hr = 0), and a QDS of the form 
C ~ \s® I^F- If ^ri') admits at least two invariant states, then Tis is not 
attractive. 

Theorem 4 (Feedback attractive subsystems) Let Hi = Hsf ffi Hr = 
Ti-s ® Ti-F ® '^i?, with dim(H5), dim(7ii?) > 2, and assume CHC capabilities. 
Then for any M , with Hermitian part , there exist a feedback Hamiltonian 
F and a Hamiltonian compensation He that make the subsystem S attractive 
for the FME pOp iff the following conditions hold: 

i) 

[nsF,M^]^0, (13) 

ii) 

n A./-«nt _ / Is^Ci., or , , 

n^^^M n^^- I Cs®If, ^^^^ 

iii) 

nsFM"n\p ^ xisF, VA e c. (15) 

Proof. By Theorem (3] condition ([T3]) is necessary and sufficient to render TLsf 
attractive, which is a necessary condition for attractivity of TLs- In fact, if this 
is not the case, by Theorem [1] there would exist an invariant subsystem whose 
support is contained TIr. To ensure invariance of 3s (H/), by Corollary [U the 
block LsF oi L = M — iF has to satisfy Lsf = Ls S Lf, with Ls = Is 
or Lp — Ip (or both). Thus, both the Hermitian and anti-Hermitian parts 
of Lsf must have the same structure. The Hermitian part of L is equal the 
Hermitian part of M, whereby it follows that (jl4p is necessary for invariance 
of Jsi'Hi)- Assume Cp ^ \p (the other case may be treated in a similar 
way, by interchanging the roles Hp and Hs in what follows). If ([15]) is not 
satisfied, then Lsf must be unitarily similar to a diagonal matrix for any choice 
of F that ensures invariance of ^siHi). Hence, the dynamics restricted to Hp 
admits at least two different stationary states {d\m.{Hp) > 2 by hypothesis). 
By Lemma [31 we conclude that 3s{Hi) cannot be attractive. Conversely, if i) 
holds, following the proof of Theorem[3l we can devise a Hamiltonian correction 
He and a feedback Hamiltonian F for which Hsp is attractive. Since the SF- 
block is irrelevant to this stage. He and F may be further chosen to render a 
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pure state of Hp attractive for the reduced dynamics. Assume ii) and iii), with 
Cp different from a scalar matrix (again, to treat the other case, Cg ^ Alg, it 
suffices to switch the appropriate subscripts in what foUows). Thus, there exists 
a one-dimensional projector pi such that [pi,Cf] ^ 0. By Corollary [51 we can 
find Fp and Hp that render it attractive. By choosing an Hamiltonian control 
so that Hsp = Is Hp, and Fsp = Is ® -FV, the stated conditions are also 
sufficient for the existence of attractivity-ensuring controls. □ 

5 Applications 

The following examples will serve to exemplify the application of our stabiliza- 
tion results to prototypical finite-dimensional control systems, which are also of 
direct relevance to quantum information devices. Different scenarios may arise 
depending on whether the target system is (or is regarded as) indecomposable, 
or explicit reference to a decomposition into subsystems is made. 

5.1 Single systems 

Example 1: Consider a single qubit on 7Y ~ C'^, with uncontrolled dynamics 
specified hy H = nol2 + rixCx + nyGy -f n^dz, with no,nx,ny,nz G M and 
M = ^ax- Assume we wish to stabilize pd = diag(l,0). Since [pd,crx] 7^ 0, this 
is possible. Following the procedure in the above proof, consider F = —^(Jy, so 



and He ~ —rixOx "nyCjy. Substituting in the FME (llOp . one obtains the desired 
result, as it can also be directly verified by using Proposition 7 in [5]. 

Assume, more generally, that it is possible to continuously monitor an arbi- 
trary single-spin observable, a ■ n. Since the choice of the reference frame for 
the spin axis is conventional, by suitably adjusting the relative orientation of 
the measurement apparatus and the sample, it is then in principle possible to 
prepare and stabilize any desired pure state with a similar control strategy. 

Example 2: Consider a three-level system (a qutrit), whose Hilbert space 
?i ~ carries a spin-1 representation of spin angular momentum observables 
Ja, a — x,y,z. Without loss of generality, we may choose a basis in Ti such 
that the desired pure state to be stabilized is pd — diag(l, 0, 0), and by CHC we 
may also ensure that H — 0. In analogy with Example 1, a natural strategy is 
to continuously monitor a non-diagonal spin observable, for instance: 



Since [pd, Jx] 7^ 0, the state is stabilizable. Choosing the feedback Hamiltonian 



that 
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as 




yields 



F^-Jy 



1 0^ 

L = + ijy ^ ^ \ Q 1 




V2 



Unlike the qubit case, H' = ^[FM + F) ^ 0, thus a Hamiltonian compensa- 
tion He is needed to ensure that i{H' + Hc)p — ^l\Lp — 0. With these choices, 
it is easy to see that T-Lpi does not support any invariant subsystem, hence pd 
is attractive. 

Provided that a similar structure of the observables is ensured, the previous 
examples naturally extend to generic d-level systems, as formally established in 
[5] by using Lyapunov techniques. 



5.2 Bipartite systems 

If a multipartite structure is specified on 7i, it is both conceptually and practi- 
cally important to understand whether stabilization of physically relevant class 
of states (including non-classical entangled states) is achievable with control re- 
sources which respect appropriate operational constraints, such as locality. We 
focus here on the simplest setting offered by bipartite qubit systems, with em- 
phasis on Markovian-feedback preparation of entangled states, which has also 
been recently analyzed within a quantum filtering approach in 36j. 

Example 3: Consider a two-qubit system defined on a Hilbert space Ti ~ 
(g) C^, with a preferred basis C — {\ab) — \a) ®\b)\a,b — 0, 1} [e.g., C defines 
the computational basis in quantum information applications). The control task 
is to engineer a QDS generator that stabilizes the maximally entangled "cat 
state" : 

p, = i(|00) + |ll))((00| + (ll|). 

In order to employ the synthesis techniques developed above, we consider a 
change of basis such that in the new representation pd = diag(l, 0, 0, 0). A 
particularly natural choice is to consider the so-called Bell basis: 

6=|-^(|00> + |ll)),-i=(|00)-|ll», 

i=(|01> + |10)),-i=(|01)-|10))|. 

Let U be the unitary matrix realizing the change of basis. In the Bell basis, 
which we use to build our controller, we consider a Hilbert space decomposition 
n^Us® Ur, where Us = span{ ^(|00) + |11))}, and = H^, and the 
associated matrix block decomposition. 
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Let us consider M = CTz (8) I in the canonical basis. It is easy to verify that 
[M, pd] + 0. In the Bell basis, = UMU'^ = I a^, and Mp = (0, 1, 0, 0). If, 
in this basis, we are able to implement the feedback Hamiltonian — \®(jy 
(where now the tensor product should simply be meant as a matrix operation), 
we render pd invariant, yet obtaining = — iF^ with Lp ^ 0. Direct 
computation yields F = U'^ {I ® ay)U — ay®G^, back in the computational 
basis. With this choice, using the definitions in the proof of Theorem [2l we 
have: 

Uw = span |i=(|01) + |10)), -^(|01) - |10)) 

and Tifl/ is itself invariant. Hence, we need to produce a control Hamiltonian He 
to "destabilize" Ti^/ . By inspection, we find that Ti^/ contains a proper subspace 
TYt = span{-^(|01) + |10))} that supports an invariant and attractive state for 
the dynamics reduced to H.ri . To "connect" this state to the attractive domain 
of Pd, we need a non-trivial Hamiltonian coupling between -i=(|00) — and 

■^(|01) + |10)). This may be obtained by a control Hamiltonian iJc — ay®\ + 
\® Oy in the standard basis - which completes the specification of the control 
strategy that renders pd the unique attractive state for the dynamics. Notice 
that both the measurement and Hamiltonian compensation can be implemented 
locally, which may be advantageous in practice. 

This example suggests how our results, obtained under CHC assumptions, 
may be interesting to explore the compatibility with existing control constraints. 
A further illustration comes from the following example. 

Example 4: Consider again the above two-qubit system, but now imagine 
that we can only implement "non-selective" measurement and control Hamil- 
tonians, i.e., M,F,H must commute with the operation that swaps the qubit 
states. It is then natural to restrict attention to the dynamics in the three- 
dimensional subspace generated by the triplet states, which correspond to eigen- 
value h?J{J -I- 1), J = 1, of the total spin angular momentum Ja = f <8i I + 
1(g) (Tq), a = x,y,z [TU]: 

nj=i = span ||00), ^(|01) + |10)), 111) 

Notice that 'Hj=i corresponds to the fixed subspace with respect to the swap 
operation. 

Our goal is to engineer a FME such that the maximally entangled state 
Pd — 5(101) -I- |10))((01| -I- (10|) is attractive for the dynamics restricted to 
Tij^i. Consider a collective measurement of spin along the x-axis, described by 
Jx- Upon reordering the triplet vectors so that in the new (primed) basis the 
z-projection ranges over 0, 1, —1 and pd — diag(l, 0, 0), we have: 
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Thus, in this basis we are looking for a feedback Hamihonian of the form: 




i i 
-i 
-i 



:) 



that is, F' corresponds to the non-selective operator F — j-{JzJy + JyJz)- Hence, 
by choosing M' = and F' as above we get: 



This, with a choice of H'^ — suffices to make pd attractive. In fact, considering 
the Hilbert space decomposition TLj=i = Hs^TIr, where Tis = span{^(|01) + 

|10))}, and Hr = Tig, we find that the largest invariant subset in Hr has 
support in Hr' = span{^(|00) - |11))}. By observing that ^(|00) - |11)) is 
not an eigenstate of Jz, we infer that the chosen control parameters make pd 
attractive in TLj=i. 

6 Conclusion 

We have revisited the fundamental concepts of invariance and attractivity for 
quantum Markovian subsystems from a system-theoretic viewpoint. Building on 
the characterization of invariant subsystems and some partial results presented 
in [8], a linear-algebraic approach and Lyapunov's stability theory methods have 
provided us with an explicit characterization of attractive subspaces, along with 
an explicit attractivity test. In the special case of a single pure state, our results 
directly characterize the semigroup generators which support state-preparation 
via dissipative Markovian dynamics. 

In the second part of the work, the conditions identified for subsystem in- 
variance and attractivity have been exploited for designing Hamiltonian and 
output-feedback Markovian control strategies which actively achieve the in- 
tended quantum stabilization. In addition to a complete characterization of 
subspaces and subsystems that can be rendered attractive, our results include 
constructive recipes for synthesizing the required control parameters, which have 
been illustrated in simple yet paradigmatic examples. While our present analy- 
sis assumes perfect detection efficiency, a perturbative argument confirms that 
unique attractive states depend in a continuous fashion on the model parameters 



Further work is needed in order to establish feedback stabilization results 
which include finite bandwidth and detection efficiency, as well as simultaneous 
monitoring of multiple observables. In addition, the analysis of Markovian sta- 
bilization problems in the presence of control resources different and/or more 
constrained than assumed here appears especially well worth pursuing. For 
instance, as illustrated in the last examples, one may want to limit possible 



/O 1 1 

L' = M' - iF' ^ V2h poo 

lo 
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operations to local or collective observables of multipartite systems in various 
settings of physical relevance. The latter may include opto-mechanical systems, 
for which feedback control strategies based on homodyne detection have been 
considered before [37j . or non-equilibrium many-body systems, for which prepa- 
ration of a class of entangled states using "quasi-local" Markovian dissipation 
has recently being investigated in a physically motivated setting |3H] . Additional 
investigation is also required to establish the full potential of Hamiltonian con- 
trol and Markovian feedback in synthesizing not only invariant and attractive, 
but also noiseless structures [5]. This may point to yet new venues for producing 
protected realizations of quantum information in physical systems described by 
quantum Markovian semigroups. 
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